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Strategy parameter adaptation in evolution strategies 



The present invention relates to an optimization method based on an evolution strategy, 
10 to a method for optimizing spline coded structures on the basis of an evolution strategy, 
~ to a-computer softwal^foTlJxecutihg sucTTalneWdayivell as to theUse of such a 
method for the optimization of the shape of aerodynamic or hydrodynamic structures. 

In the field of evolution strategy, basic principles of natural evolution are used for 
15 generating or optimizing technical structures. Basic operations are mutation and 
recombination as a method for modifying structures or parameters. To eliminate 
unfavorable modifications and to proceed with modifications which increase the overall 
quality of the system, a selection operation is used. Principles of the evolution strategy 
can be found for example in Rechenberg, Ingo (1994) ..Evolutionsstrategie", Friedrich 
20 Frommann Holzboog Verlag. 

With reference to figure 1 at first the known cycle of an evolution strategy will be 
explained. 



25 In a step 1 the object parameters to be optimized are encoded as real numbers in a 
vector called individual or chromosome. One individual can alternatively also consist of 
several vectors or chromosomes. A number of such individuals are generated that 
comprise the initial parent generation and the quality (fitness) of each individual in the 
parent generation is evaluated. In a step S2 the parents are reproduced by applying 

30 operators called mutation and recombination. Thus, a new generation is produced in 
step S3, which is called the offspring generation. The quality of the offspring 
individuals is evaluated using a fitness function which is the objective of the 
optimization in step S4. Finally, depending on the calculated quality value, step S5 
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selects (possibly stochastically) the best offspring individuals (survival of the fittest) 
which are used as parents for the next generation cycle if the termination condition in 
step S6 is not satisfied. 

5 In particular for this application the real number vector, the object parameter, 
represents the coding for a spline which describes a two or higher dimensional body. 
This mapping from the parameter vector to the spline encoded structure is usually 
referred to as the genotype (= the parameter vector) - phenotype (=the two or higher 
dimensional body) mapping. In order to determine the fitness in step S4, first the 

10 genotype is mapped to the phenotype and then the quality of the phenotype is derived. 

_ A"particular'example~is~ the parameterization of^~aiifoir(^th¥^lienotyperbjr^ real^ 
valued vector (= genotype) describing a spline which determines the geometry of the 
airfoil. Finally, the quality of the airfoil can be determined, e.g. by methods known 
from computational fluid dynamics. 

15 

The mutation operator for the reproduction in step S2 is realized by adding normal or 
Gaussian distributed random numbers to the already existing elements of the parameter 
set, the so-called chromosome. The step size of the mutation can be controlled by 
modifying the variance of the normal or Gaussian probability density function. The 
20 variances are called strategy parameters. In higher dimensions the strategy parameters 
can consist of all or some entries of the covariance matrix of the higher dimensional 
Gaussian probability density function. This method to control the mutation by means of 
strategy parameters particularly distinguishes evolution strategy from other evolutionary 
algorithms like genetic algorithms (GA) or genetic programming (GP). 

25 

Appropriate values for the strategy parameters are important for the convergence of the 
algorithm. The appropriate values depend on the problem and the actual position in the 
solution space. To adapt the mutation width online, different adaptation strategies are 
used. Some simple methods are the 1/5 rule (see Rechenberg) or the so-called mutative 
30 step size control. More complex methods are, for example, the de-randomized 
adaptation method or the co-variance matrix adaptation. 
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Evolution strategies have been shown to outperform other evolutionary algorithms like 
genetic algorithms or genetic programming for real-valued parameter optimization 
problems due to the above-mentioned possibilities of the adaptation or self-adaptation of 
the step size(s) of the mutation operator. 

A known problem for the application of evolution strategy to design optimization is that 
the number of parameters which describe the model (the so-called object parameters) is 
fixed in evolution strategy. Therefore, an automatic refinement of the phenotype 
represented by the object parameters during the optimization is impossible. 



Mathematically, the mutation operation step can be expressedby the following equation" 
(1): 

tf(6,<5>) (1) 



x° = x F + 



thereby x represents the parameter set of the offspring, x p represents the parameter 
set of the parents and Af(6,<x P ) represents a vector whose elements are normal 
distributed random numbers with zero mean with variances a P i 2 . As can be seen from 
Fig. 3, a larger strategy parameter a Pi increases the probability for larger steps in the 
20 offspring mutation. 

More generally, the mutation operation can be represented by the following equation 
(2): 

25 x°=x F +6 (2) 



wherein 



(2*)"" ""V 2^~ ^ »* "J (3) 
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Fig. 3a and b show the resulting probability distribution for placing an offspring, 
wherein Fig. 3a shows a 3D-plot and 3b shows a contour-plot. 8 is a random vector 
with a general Gaussian probability density function as specified in Eq. (3), if the 
5 covariance matrix Z is diagonal, Eq. (2) is reduced to Eq. (1) where the elements of 
the vector (<x p ), the variances a P i 2 , are the diagonal elements of Z. 

The covariance matrix Z has to be adapted to the local quality function. Fig. 4d shows 
the self-adaptation of the strategy parameters (covariance matrix Z) to the local quality 
10 function. Particularly, Fig. 3c shows the result of four cycles of the reproduction 
process, wherein the 3d surface represents the quality function. By the self-adaptation 
of the strategy parameters to the local quality function regarding the direction and the 
step size a good convergence towards the absolute maximum of the local quality 
function can be achieved. 

15 

It is the object of the present invention to deal with the problem of variable parameter 
set length in evolution strategy in particular in context with the self-adaptation property 
of the strategy parameter set. With other words, the present invention proposes a 
technique for automatically refining the phenotype described by the parameter set 
20 during the optimization. 

This object is achieved by means of the features of the independent claims. The 
dependent claims develop further the central idea of the present invention. 

25 According to the present invention, the size of the describing parameter set during the 
evolution process can be adapted. For example, in the beginning a very small parameter 
set can be used to find a rough approximation of the optimal shape, which can be 
achieved very fast. During the optimization, the parameter set can be expanded to 
describe more and more complex shapes. However, the parameter set can not only be 

30 changed by inserting new object parameters and appropriate strategy parameters, but 
also by removing some parameters. This can be the case f.e. if an object parameter 
shows to be not sufficiently useful for further optimization. 
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When expanding the number of object parameters in the parameter sets, the associated 
number of strategy parameters has also to be expanded by inserting new strategy 
parameters. The present invention therefore proposes a technique for estimating the 
5 value of newly inserted strategy parameters. 

According to a first aspect of the present invention therefore an optimization method 
based on an evolution strategy is proposed. A model, structure, shape or design to be 
optimized is thereby described by a parameter set comprising object parameters which 
10 are mutated and/or recombined to create offsprings of the parameter set. The quality of 
~the off^mgnsTfienT^alu^ comprises at leasi~bneT 

strategy parameter representing the variance of the mutation of associated object 
parameters. Thereby, the number of object parameters as well as the number of 
associated strategy parameters can be adapted during the optimization process. 

15 

For example the object parameters and strategy parameters can be selectively inserted 
and/or removed. 

The value of a newly inserted strategy parameter can be estimated based on the 
20 information of strategy parameters of correlated object parameters. 

The position and/or the time of a removal or an insertion of an object parameter and an 
associated strategy parameter can be determined by a random function. 

25 The changes of the object parameter set and the associated strategy parameters can be 
performed such that it has no influence on the result of the evaluation step, thus the 
change of the parameters can be selectively neutral. 

According to a further aspect of the present invention, an optimization method based on 
30 an evolution strategy is proposed. Thereby the structure of a parameter set defined by 
the number and/or position of the object parameters and strategy parameters can be 
mutated to create these offsprings. 
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According to a still further aspect of the present invention, a method for the 
optimization of spline coded problems is proposed. The object parameters in this case 
can comprise control and knot points, wherein new control points and strategy 
parameters can be inserted. 

5 

The values of newly inserted strategy parameters can be estimated on the basis of the 
values of the strategy parameters of neighboring control points. 

According to a further aspect of the present invention, a method for optimizing spline 
10 coded shapes on the basis of an evolution strategy is proposed. Thereby a model, 
stracture "shape" o^^ is describe^~by~a~p^ameter sercomj^ing 

object parameters representing control points and knot points of the spline coded shapes 
and at least one strategy parameter representing the variance of the mutation of 
associated object parameters. The object parameters and strategy parameters are 
15 mutated to create offsprings of the parameter set. Finally, the quality of the offsprings 
is evaluated. According to the invention, the step of mutating comprises the step of 
determination of a control point insertion position, insertion of the control point, 
adjustment of the knot vector, insertion of the appropriate strategy parameter for the 
inserted control point, weighted averaging of the strategy parameter values of the 
20 modified control points, and assigning the weighted average value as the value of the 
inserted strategy parameter. 

According to a further aspect of the present invention, a computer software program for 
executing a method as said above is proposed. 

25 

Finally, the invention proposes the use of such a method for the optimization of the 
shape of aerodynamic or hydrodynamic structures. 

Further features, objects and advantages of the present invention will become evident 
30 for the man skilled in the art when reading the following description of embodiments of 
the present invention when taken in conjunction with the figures of the enclosed 
drawings. 



Fig. 1 shows a schematic representation of an evolutionary algorithm. 

Fig. 2 is a graphic representation showing the influence of the strategy 

parameter value. 

Fig. 3 shows the relation between the strategy parameter and the direction and 
step size of the evolution strategy process. 

Fig.4 shows schematically the structure mutation for individual step size 
adaptation of the strategy parameter. Note, that the neighboring control points 
and strategy parameters might also be affected by the structure mutation. 



Fig. 5 shows schematically the structure mutation for the covaxiance matrix 
adaptation of the strategy parameter. Note, that the neighboring rows and 
columns in the co variance matrix might also be affected. 

Fig. 6 shows a flow-chart for the process of adapting the structure of a 
parameter set by inserting/removing strategy and object parameters. 

Fig. 7 shows different hierarchies of mutations. 

Fig. 8 is a schematic flow chart showing the mutation of the structure of a 
parameter set. 

Figs.9 and 10 show an application example of the present invention: the 
optimization of spline coded shapes. 

Fig. 11 shows the application of the present invention to the optimization of the 
shape of an aerodynamic or hydrodynamic body. 

The principles of evolution strategy have already been explained with reference to Figs. 
1 to 4. The general difference between the present invention and the prior art in 
evolution strategy is that the structure of the genotype, i.e., the structure of the 
parameter set including the strategy parameters, can also be mutated. With other words, 
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both the number of object parameters and strategy parameters of a parameter set can be 
changed. Therefore, the optimization process can start with a relatively low number of 
parameters and the complexity of the parameter set can be refined during the 
optimization process 

With reference to Figs. 4 and 5, the time point and/or the location for the insertion of a 
new object parameter in the existing parameter set can be defined for example by means 
of a random function. When inserting a new object parameter, at the corresponding 
location of the strategy parameters a new strategy parameter is inserted such that the old 
^chromosome" (parameter set comprising object parameters and strategy parameters) is 
"extended ~to~a"riew"chro^ 

individual mutative step size adaptation. Note, that neighboring object and strategy 
parameters might also change after the modification. 

The structure mutation of the co variance matrix is schematically shown in Fig. 5. The 
strategy parameter according to this embodiment is represented as the covariance matrix 
2 (see equation (3) further above). When inserting a new object parameter in the old 
chromosome to create an extended chromosome, the covariance matrix I is adapted by 
inserting a new row and a new column, thus generating a new expanded covariance 
matrix Z\ The parameter set according to this representation is composed of the object 
parameter set and the strategy parameter, e.g. the co-variance matrix I. Note, that 
neighboring rows and columns of the covariance matrix might be affected by the 
modification. 

The present invention is for example applied to the field of optimization of spline coded 
problems. An example of a spline coded problem is shown in Figs. 10 to 12. Typically 
in such spline coded problems, all attributes of the shape are encoded in the parameter 
set (control points, knot points which comprise the object parameters and the strategy 
parameters). Attributes which are not encoded cannot be represented and therefore 
cannot be subject of the optimization. As a consequence thereof, attributes cannot 
evolve during the optimization as long as they are not included in the parametric 
description of the parameter set. 
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The present invention now allows for an online modification of the parametric 
description (modification of the structure of the genotype) in order to allow new 
attributes in the encoding and therefore also in the shape (=the phenotype) to be 
inserted. Note, that the parameter set can not only be expanded by inserting new object 
5 and strategy parameters, but also be reduced by removing these parameters. This can be 
the case f.e. if an object parameter shows to be not sufficiently useful for further 
optimization. 



As has already been said, one of the main advantages of the evolution strategies 
10 compared to other evolutionary algorithms is the use of the strategy parameters which 
can represent a preferrM dir^tiOT 

parameters are also adapted (mutated) in evolution strategies during the optimization to 
the local properties of the quality function. When new components (new control points 
in the case of spline coded problems) are inserted in the encoding or the encoding is 
15 modified, the values of the newly inserted strategy parameters have to be calculated. 

According to the present invention, when determining a value of a newly inserted 
strategy parameter, the information of correlated components, e.g. the information of 
correlation parameters associated with correlated object parameters is used. 

20 . ... 

In the case of spline encoded structures, strategy parameters of new points are usually 
similar to strategy parameters of their neighboring points. Therefore, in the case of 
spline encoded structures, the strategy parameter value can be estimated from the 
strategy parameter values of neighboring control points. 

25 

The optimization process for a spline encoded problem or structure can therefore be 
represented in a simple way as follows: 



- definition of an initial spline encoding (object parameter set) for the 
geometric shape (for example hydrodynamic or aerodynamic bodies such as 
an airfoil) and of an initial strategy parameter set (f.e. covariance matrxi) 

- performing the steps of a standard evolution strategy for optimization 
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- introducing (possibly at random) new control point(s) in the spline 
encoding (new parameters) due to any predefined measure, f.e. stagnation 
of improvement with current encoding or as an additional mutation operator 

- estimation of the new strategy parameter values based on existing strategy 
5 parameters, and 

- continuation of the standard evolution strategy for optimization. 

This process usable for example for spline encoded problems will now be explained 
with reference to Fig. 6. 

10 

lQ-g te p si~the~initial encoding of ~the problemT for ex^pl^ represented by control and 
knot points, is set. In step S2 it is decided whether the encoding should be mutated. 
This decision can for example be triggered by a random function or a function that 
depends on the progress of the optimization. In case the result of step S2 is yes, in step 

15 S3 it is decided whether a new control point is to be inserted. If the answer of the 
decision step S3 is yes (which can be again decided on the basis of a random function 
or some kind of sensitivity analysis of the spline coding), the position for the newly to 
be inserted control point has to be found in step S4. Therefore the index i of the newly 
to be inserted point representing the position of the newly inserted point in the 

20 parameter set has to be found in step S4 and the new control point is inserted at the 
index i in step S5. Finally in a step S6, the value of the correspondingly to be inserted 
strategy parameters strat, is calculated. The value of the newly inserted strategy 
parameters strati is a function f(strat ^.strat of the values of the neighboring 
strategy parameters /-/ and i +7 or in more general terms a function of a subset of all 

25 old strategy parameters. 

In case it is decided in step S3 to mutate the coding without insertion of a hew control 
point, the removal position has to be chosen in step S7 and the corresponding control 
point is removed in step S8. 

30 

Finally, the parameter set including the control points, knot points and strategy 
parameter is mutated in step S9. The resulting structure of this mutation step S9 is then 
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evaluated in step SIO using a so-called fitness function, f.e. measuring the fluid- 
dynamics properties of the spline coded shape. 

In step Sll, it is checked whether all individuals, i.e., all parameter sets (comprised of 
5 the object parameters and the strategy parameters) have been mutated. If this is not the 
case, the process goes back to step S2. 

If the decision in Sll is positive, the n best individuals out of the m individuals 
generated in step S9 and evaluated in step SIO are selected in step S12 ("survival of the 
10 fittest"); this corresponds to a (n,m) selection, other selection methods like (n+M) or 
tournament selection, etc. can be applied." Affer Ihe ^lectib^"process^ tfie"6ptimi^ion 
is either stopped, S13, in case some pre-defined criterion has been reached or a new 
generation is started with the reproduction step in S14 and a new mutation step in SI, 

15 Fig. 7 shows the different hierarchies of mutations possible according to the present 
invention. 

The mutation of the parameter set (object parameters S15 and strategy parameters S16) 
in a step S9 is already known. However, according to the present invention,, also the 
20 structure, e.g. the number and position of the object parameters and strategy parameters 
of the parameter set can be mutated in a step S17 (comprising the steps S2 to S8 in Fig. 
6). 

Fig. 8 summarizes the optimization processing as shown in Fig. 6. The genotype is first 
25 extended by inserting a new object parameter in step S3a. The value of this new 
parameter is estimated from the existing object parameter values in step S3b, f.e. in 
order to minimize the initial variation of the phenotype following the extension of the 
genotype. Once the position and the value of the new object parameter has been 
calculated in steps S3a and S3b, the position and the value of the new strategy 
30 parameter is calculated using already present strategy parameters corresponding to the 
object parameters used in the estimation of the value for the new object parameter (step 
S3b). 
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Finally, an extended genotype with optimized strategy parameters for the new object 
parameters is generated. 



A simple example for the application of the present invention on a spline encoded 
5 structure is shown in Figs. 9 and 10. The problem in this case is the approximation of a 
circle by a polygon with a fixed (Fig.9) and a variable (Fig. 10) number of edges. The 
present invention (Fig. 10) has the advantage that this simple optimization process can 
be started with a structure with few parameters, f.e. a triangle, whose number is 
subsequently increased during the optimization. Due to the iterative development the 
10 evolution does not get stuck like in Fig.9, where the degree of freedom is too large for 
" the strategy paiSnetef is fo~MaptT 

The mutation process for such spline encoded structures can be summarized as follows: 

15 1. Based on a simple structure (small number of object parameters), a control 

point insertion position is determined. 

2. The control point is inserted at the determined insert position. 

20 3. The knot vector is changed according to the inserted control point. 

4. To calculate the value of the new strategy parameter for the new control 
point, a weighted averaging of the strategy parameters of the neighboring 
control points is performed, and 

25 

5. The weighted average value is assigned as value for the new inserted 
strategy parameter. 

According to the description, the present invention finds application for all structure 
30 encodings in which the optimal strategy parameter can be estimated from already 
existing strategy parameters. 
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Fig. 11 visualizes the estimation of strategy parameters and the application of the 
present invention to the design of airfoils. R5 thereby designates the airfoil. R6 
designates the control polygon for the spline which approximates the airfoil. R9 
designates an already present control point and the ellipsoid RIO around this control 
point, R9, visualizes the probability density distribution according to the strategy 
parameter which is the expected area for modification. R7 designates a new inserted 
control point having a strategy parameter R8 represented by the gray-shaded area. 

Further examples for the application of the present invention apart from airfoil shapes 
are compressor/turbine blades for gas turbines (stator and rotor blades) and other 
aerodynamic~or hydrodynamic structures. Other fields of "application are architecture 
and civil engineering, computer science, wing design, engine valve design and 
scheduling problems. 
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Honda R&D Europe (Deutschland) GmbH 
P24177 

"Strategy Parameter Adaptation" 
5 Claims: 

1. Optimization method based on an evolution strategy, comprising the following steps: 

- a model, structure, shape or design to be optimized is described by a parameter set 
comprising object parameters, 

10 - the object parameters are mutated and/or recombined to create offsprings of the 
parameter set, ™ " — ™ 

- the quality of the offsprings is evaluated, 

wherein the parameter set furthermore comprises at least one strategy parameter 
representing a step-size of the mutation of associated object parameters, 
15 characterized in that 

the number of object parameters as well as the number of associated strategy parameters 
can be adapted (S2) during the optimization process. 

2. Optimization method according to claim 1, 
20 characterized in that 

object parameters and strategy parameters can be selectively inserted (S4-S6) and/or 
removed (S7). 

3. Optimization method according to claim 1 or 2, 
25 characterized in that 

the value of a newly inserted strategy parameter is estimated (S6) based on the 
information of strategy parameters associated with correlated object parameters. 

4. Optimization method according to any one of the preceding claims, 
30 characterized in that 

the position and/or the time of a removal or insertion of an object parameter and an 
associated strategy parameter is determined by a random function. 




EPO- Munich 
6 

2&Feb. 2001 



15 



5. Optimization method according to any one of the preceding claims, 
characterized in that 

the position and/or the time of a removal or insertion of an object parameter and an 
5 associated strategy parameter is determined by the progress of the evolutionary 
optimization. 

6. Optimization method according to anyone of the preceding claims, 
characterized in that 

10 the structure mutation of the object parameters and the associated strategy parameters is 
peHbTmed sucfr on the - resulFof the~evaluation step~(SlO)7~ 

7. Optimization method based on an evolution strategy, comprising the following steps: 

- a model, structure, shape or design to be optimized is described by a parameter set 
15 comprising object parameters, 

- the object parameters are mutated (S9, SI 5, SI 6), to create offsprings of the 
parameter set, 

- the quality of the offsprings is evaluated (S10), 

wherein the parameter set furthermore comprises at least one strategy parameter 
20 representing the step-size of the mutation (f.e. the variance of the normal distribution) 
of associated object parameters, 
characterized in that 

furthermore the structure of a parameter set defined by the number and/or position of 
the object parameters and strategy parameters is mutated (S17) to create said offsprings. 

25 

8. Method for the optimization of spline coded structures/shapes/designs, 
characterized in that 

it comprises a method according to anyone of the preceding claims. 

30 9. Method according to claim 8, 
characterized in that 

the object parameters comprise control and knot points and in that new control points 
and strategy parameters can be inserted (S3) and the knot vector is adapted accordingly. 
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10. Method according to claim 9, 
characterized in that 

the values of newly inserted strategy parameters are estimated (S6) on the basis of the 
5 values of the strategy parameters of neighboring control points. 

11. Method for optimizing spline coded problems on the basis of an evolution strategy, 
comprising the following steps: 

- a model, structure, shape or design to be optimized is described by a parameter set 
10 comprising object parameters representing control points and knot points and at least 

bneTstrategy parameter representing the step-size 7>f the mutation (feTthe variance of 
the normal distribution) of associated object parameters, 

- the object parameters and strategy parameters are mutated (S9, S15, S16) to create 
offsprings of the set, 

15 - the quality of the offsprings is evaluated (S10), 
characterized in that 
the step of mutating comprises the steps of 

- determination (S4) of a control point insertion, 

- insertion (S5) of the control point in the parameter set, 

20 - insertion of a strategy parameter for the inserted control point, 

- determination of the knot points modified by the insertion of the control points, 

- weighted averaging (S6) of the strategy parameter values of the modified control 
points, and 

- assigning the weighted average value as the value of the inserted strategy parameter. 

25 

12. Computer software for executing a method according to anyone of the preceding 
claims. 

13. Use of a method according to anyone of claims 7 to 11 for the optimization of the 
30 shape of aerodynamic or hydrodynamic structures. 
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Abstract 

The present invention relates to a optimization method based on an evolution strategy 
according to which a model/structure/shape/design to be optimized is described by 

TO parameter sets comprising object parameters. The object parameters are mutated to 
create offsprihgs^orthe^ parameter set. The quality of the offspnngsls"^ 
parameter set furthermore comprises at least one strategy parameter representing the 
step-size of the mutation (f.e. the variance of the normal distribution) of associated 
object parameters. The number of object parameters as well as the number of associated 

15 strategy parameters can be adapted during the optimization process. The value of newly 
inserted strategy parameters can be estimated based on the information of correlated 
object parameters. 

(Fig. 1) 
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